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Abstract 

We present novel results that relate energy and information transfer with sensitivity to initial conditions in chaotic multi- 
dimensional Hamiltonian systems. We show the relation among Kolmogorov-Sinai entropy, Lyapunov exponents, and upper 
bounds for the Mutual Information Rate calculated in the Hamiltonian phase space and on bi-dimensional subspaces. Our 
main result is that the net amount of transfer from kinetic to potential energy per unit of time is a power-law of the upper 
bound for the Mutual Information Rate between kinetic and potential energies, and also a power-law of the Kolmogorov- 
Sinai entropy. Therefore, transfer of energy is related with both transfer and production of information. However, the 
power-law nature of this relation means that a small increment of energy transferred leads to a relatively much larger 
increase of the information exchanged. Then, we propose an "experimental" implementation of a 1 -dimensional 
communication channel based on a Hamiltonian system, and calculate the actual rate with which information is exchanged 
between the first and last particle of the channel. Finally, a relation between our results and important quantities of 
thermodynamics is presented. 
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Introduction 

After the pioneering work by Shannon [1] on information, it 
became clear that it is a very useful and important concept as it 
can measure the amount of uncertainty an observer has about a 
random event and thus provides a measure of how unpredictable it 
is. The degree of disorder of a chaotic dynamical system is related 
to the degree of its chaotic behavior which is, in turn, 
characterized by the rate of exponential divergence of neighboring 
initial conditions, that is by the magnitude of the positive 
Lyapunov exponents [2]. It is the sensitive dependence on initial 
conditions [2-4] that produces information since two different but 
indistinguishable initial conditions at a certain precision will evolve 
into distinguishable states after a finite time [3]. This relation 
between production of information and sensitive dependence was 
made clear for systems that have absolutely continuous conditional 
measures [5,6], by: 

tfKS = X>, (1) 

i 

where //ks represents the Kolmogorov-Sinai or KS entropy 
(Shannon's entropy per unit of time) and A; are the positive 
Lyapunov exponents of the dynamical system [2,3,7,8], which 
measure how sensitive to initial conditions the system is. This is a 
property that has been found to be true for many dynamical 
systems [3]. In general, for bounded systems i/jcs < ICi ^'"> h>® 
[9]. 



Energy and information can be produced in a system or 
transferred between its different "parts" or "constituents" [10-12]. 
If transferred, there are always at least two "entities" involved. In 
general, they can be nodes, modes, or related functions that can be 
defined on subspaces or projections of the phase space of the 
system. 

Another related concept to the Shannon entropy that can 
characterize random complex systems is the Mutual Information 
(MI) [1] which is a measure of how much uncertainty one has 
about a state variable after observing another state variable. For 
deterministic systems that present correlations, a more appropriate 
quantity for measuring the transfer of information is the Mutual 
Information Rate (MIR), MI per unit of time. In Refs. [10,13-15], 
the authors have developed alternative methods to overcome 
problems that stem from the definition of probabilities for these 
quantities and proposed the use of bounds for the MIR. In Ref. 
[10], the authors have derived an upper bound for the MIR 
between two nodes or two groups of nodes that depend on the 
largest Lyapunov exponents of the subspace of the network formed 
by the nodes. In particular, they have showed that: 

MIR</ f =h-l 2 , /i>/ 2 , (2) 

where l\ and h are the two finite time and size Lyapunov 
exponents calculated in the bi-dimensional observation space 
which for simplicity will be referred herein as the Lyapunov 
exponents of the bi-dimensional subspace. In our study, when the 
observation space is formed by the kinetic (K) and potential (P) 
energy variables of the Hamiltonian, then the upper bound for the 
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MIR in the KP space if = if - if (i.e. h = if and h = if) 
represents the upper bound for the information transferred per 
unit of time between the kinetic and potential energies. The use of 
the KP space to study the relationship between energy and 
information exchange is justifiable because the transfer of energy 
from kinetic to potential energy is easy and well understood. 
However, we will also study this relationship in other bi- 
dimensional subspaces such as those formed by any two nodes 
of the Hamiltonian system. 

The main result of our work is Eq. (26), which states that when 
considering specific energy subintervals, the time rate of energy 
transferred from the kinetic to the potential variable during a time 
step is a power-law function of either the largest Lyapunov 
exponent 1\ of the Hamiltonian or of the upper bound if for the 
MIR of the bi-dimensional KP space. 

We then present the generalization of these power-law relations 
when considering much larger energy intervals of chaotic behavior 
with initial conditions set initially in different parts of the phase 
space of the same Hamiltonian system. We also consider different 
Hamiltonian systems in which we illustrate how they can be used 
to create communication systems. 

The second main result is Eq. (1) of Information SI which states 
that the upper bound for the MIR exchanged between the 
potential and kinetic energy is smaller than the upper bound for 
the MIR between two groups of oscillators formed each by half the 
oscillators of the Hamiltonian, and this is in turn smaller than the 
whole time rate of information produced by the system expressed 
by //ks- We provide a proof of this result in Information SI. This 
result implies that, when one observes a Hamiltonian system 
through its kinetic and potential energy (i.e. in its KP space), one 
should not expect to have more information about the Hamilto- 
nian system than when observing it directly (i.e. by observing half 
of its nodes or all of its variables). 

The relation among energy, entropy, and information is a long 
lasting problem in physics. Nineteenth century saw the discovery 
of the two laws of thermodynamics, almost happening at the same 
time. The first law relates the rate of change of the energy of a 
body with the heat and work produced and the second, the rate of 
the change of the entropy of the body with the heating, implying 
the growth of its entropy during an adiabatic and irreversible 
process. Thermodynamics turned out to be a very important 
mathematical theory that can describe successfully macroscopic 
systems in equilibrium, based on the thermodynamic laws and 
provides a link between work, energy, and entropy as a universal 
competition, i.e. when a body approaches equilibrium, energy 
tends to a minimum and entropy to a maximum (see for example 
Ref. [16]). 

In 1929, after a long lasting controversy, Leo Szilard [17] and 
more recently the authors in Refs. [18,19], showed that Maxwell's 
hypothetical demon does not contradict the second law of 
thermodynamics, implying that in principle one can convert 
information to free energy. By free energy we mean the portion of 
the energy of a system that is available to perform work mediated 
by thermal energy. It was only very recendy in 2010 [20], that an 
experimental demonstration of this information to energy conver- 
sion has been achieved. 

In Ref. [11], the authors study the energy transfer in terms of 
the classical dynamics of two particles that move in harmonic 
potential wells, interacting with the same external environment of 
N noninteracting chaotic systems. They found that the oscillators 
can exchange energy through the environment when in almost- 
perfect resonance and in Ref. [12], a simple and solvable model of 
a device that transfer energy from a cold to a hot system by 
rectifying thermal fluctuations is presented. In order for this to 



happen, the device requires a memory register to which it can 
write information. The subtle issue of the connection between 
work and information processing is presented in Ref. [21] in a 
solvable model of an autonomous Maxwell's demon. The authors 
studied and explained a device that makes measurements about 
the system states, stores this information into a register, and 
delivers work by rectifying thermal fluctuations. 

In this work however, we are interested in providing the relation 
between energy transfer and information production and transfer 
in multi-dimensional chaotic Hamiltonian systems, e.g. in isolated 
systems where the total energy of the system remains constant and 
no exchange of heat or matter with the surroundings exists. Such a 
relation could allow one to realize how much information a sort of 
Maxwell's demon would need in order to be able to transfer a 
certain amount of energy between oscillatory modes in Hamilto- 
nian systems. Hamiltonian systems such as those we study herein 
differ from thermodynamic systems in the sense they are far from 
the thermodynamic limit, i.e. they have a small dimensionality. 
However, in the Discussion session, we provide a link between our 
results and important quantities of thermodynamics. 

The paper is organized as follows: In Sec. Materials and 
Methods we present the basic material needed in our study. This 
includes the presentation of the two Hamiltonian systems and 
some of its important properties, the definition of the KP bi- 
dimensional observation space and a brief discussion about 
important quantities from the theory of information such as upper 
bound for MIR and KS entropy. In Subsec. Relation Between 
Largest Lyapunov Exponent of the Bi-dimensional KP Space and 
of the Hamiltonian, we present the relation between the largest 
Lyapunov exponent of the Hamiltonian system and that of the bi- 
dimensional space of the kinetic and potential energy. Then, in 
Subsec. Relation Between Production and Transfer of Information 
in the Small Energy Regime, we explain how one can arrive at Eq. 
(26) about the relation between production and transfer of 
information when considering specific energy subintervals of 
chaotic behavior. In Subsec. Generalization of our Study, we 
generalize the main results of our study by considering the case of 
different Hamiltonian systems for much larger energy intervals 
and with initial conditions set in different parts of the phase space 
of the systems. Then, in Sec. Hamiltonian Communication 
System, we illustrate how one can implement a 1 -dimensional 
communication channel based on a Hamiltonian system, and 
calculate the actual rate with which information is exchanged 
between the first and last particle of the channel. In the Discussion 
section we briefly recall the main results of our study, their 
implications and relation with quantities of thermodynamics. 
Finally, in Information S 1 we provide a proof of the inequality 
presented in Eq. (1) in there. 

Materials and Methods 

Fermi-Pasta-Ulam Hamiltonian 

In this work we use two different Hamiltonian systems. We first 
consider the 1 -dimensional lattice of N particles with equal masses 
and nearest neighbour interactions with quartic nonlinearities (fi- 
model) given by the Fermi-Pasta-Ulam (FPU) Hamiltonian [22] : 

H(x,x) = l - £ x] + Yl 4 (X >+ 1 " X > )2 + \ P(X J + 1 ~ X ' )4) = E (3) 

7=1 7=0 

adopting fixed boundary conditions: 
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x 0 (t) = x N+1 (t) = 0,\/t. 

Here, Xj and Xj is the position and conjugate momentum of the 
y'th particle, respectively. 

For this system, we use initial conditions in the neighborhood of 
two particular simple periodic orbits of (3) which are called SPO 1 
and SP02 [23,24]. The reason for this choice is that they allow us 
to control in a systematic way the increase of the energy of the 
system so that chaotic motion will be sustained. Any other way of 
increasing the energy of the system so that chaotic behavior can 
exist may be equally used as well. 

SPO 1 is specified by the conditions: 

N-l 

x 2j (t) = 0, x 2j - 1 (0 = -xy+ 1 (0 = x(t), j=l,..., — ^— , (4) 

and exists for all odd N, keeping every even particle stationary at 
all times. It is not difficult to show that this is, in fact, the 
q = (N +l)/2 mode of the linear lattice (i.e. 0 = 0) with frequency 
m q = \f2. The remarkable property of this solution is that it is 
continued in precisely the same spatial configuration in the 
nonlinear lattice as well, due to the form of the equations of 
motion associated with Hamiltonian (3): 

Xj(t) = xj+\ -2xj + Xj-i+fS((x j+ \ -xjf -(xj-Xj-if)J= 1, ...,N ( 5 ) 

which reduce, upon using (4) with the fixed boundary conditions to 
a single second order nonlinear differential equation for x(t): 



E _ 2k 2 {\-k 2 ) 
N+l ~ 30(1 -2k 2 ) 2 ' 

We treat £ as a control parameter for the chaoticity of the FPU 
system (3). From now on, we drop the time-dependence notation 
of all involved variables for simplicity but use it wherever is 
needed. 

Bose-Einstein Condensate Hamiltonian 

The second Hamiltonian system we use in this paper is the 
Bose-Einstein Condensate (BEC) model [24] which is given by: 

H=\±(xj + xj) + l±(xj + xf) 2 -\±(xjx J+l+Xj x J+ ^ 

7=1 7=1 7=1 

where Xj, Xj is the position and conjugate momentum of the y'th 
particle (i.e. boson), respectively. 

It possesses the second integral of motion: 

F=f> 2 + x 2 ), (11) 

7=1 

and therefore chaotic behavior can only occur for 7V>3. 
We impose periodic boundary conditions in Eq. (10): 

Xff+i(t) = xi(t) and 



x(t)=-2x(t)-2Px 3 (t) (6) 

describing the oscillations of all moving particles of SPO 1 , with 
j= 1,3,5, . . . ,N. For the stationary particles (i.e. 
7 = 2,4,6, ...,7V- 1) we have x(0 = 0,W>0. The solution of (6) 
is well known in terms of Jacobi elliptic functions [25] and can be 
written as: 



x N+ i(t) = xi(t), Vf, (12) 

and use, for the same reason as in the FPU case, initial conditions 
set in the neighborhood of the out-of-phase mode (OPM): 

xj(t)= -x J+] (t) = x(t), 



where: 



x(t) = Ccn(/Lt,K 2 ), 



2k 2 



0(1 -2k 2 )' 



1-2k 2 



(7) 



(8) 



and K is the modulus of the cn elliptic function. The energy per 
particle of SPO 1 is then found to be: 

-C 2 (2+C 2 0) 



E 1 „,,_ v>„ K 2 (l-K 2 ) 



tV+1 



0(1 -2k 2 ) 



2V* 



(9) 



by substituting simply the solution x(i) of Eq. (7) in Hamiltonian 

(3). 

SP02 is defined in a similar way. In particular, it exists for 
YV = 5 + 3m, m = Q, 1,2, . . . and corresponds to the case where 
every third particle is fixed, while the two in between move in 
opposite directions (in an out of phase fashion). Following similar 
arguments as for the SPO 1 mode, the energy per particle of SP02 
is given by [23]: 



Xj (t) = - x j+ 1 (?) ee x(t), V/ = 1, . . . ,N 
with TV being even. 



(13) 



Observation Subspaces and Quantities Calculated on 
Them 

The FPU system (3) can be simply written in the form: 



H = K + P=E= const 



(14) 



where: 



K=\Y J x 2 and 

7=1 



7=1 



(15) 
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However, the BEC system (10) is not written in the same form 
and this will allow us to generalize the results of our study in the 
case where the KP space is not implied directly by the 
Hamiltonian form. 

In our analysis, we define and study quantities like Lyapunov 
exponents initially in the bi-dimensional KP space, since K is a 
meaningful physical quantity. Potential energy can be easily 
measured as well or estimated since P = E — K. However, we also 
consider the (x\ ,Xn) observation space which is constructed by the 
position coordinates of the first and last particle of the 
Hamiltonian. For the FPU case, we know that: 



dH dK dP _ Q 
dt dt dt 



(16) 



where: 



dK 
dt 



= ^ kj'xj and 



(17) 



7 = 1 



dP 

dt ' 



7=1 



Equation (16) is valid since the FPU Hamiltonian (3) is a global 
integral of the motion and thus a conserved quantity during time 
evolution. 

Along the lines of ideas presented in Ref. [10], we compute the 
upper bound I c for the MIR between any two groups of N/2 
nodes each. The upper bound I c for the MIR is defined as (see 
supplementary material in Ref. [10]): 



In a series of papers [24,26-31], the authors report for 
dynamical systems ranging from different kinds of billiards to 
multi-dimensional Hamiltonian systems, that the largest Lyapunov 
exponent k\ of the system scales with the energy E with a power- 
law of the form: 



Aioc£* 



(20) 



where b is a real positive constant. This power-law dependence is 
valid for a rather large energy interval that can support chaotic 
behavior. 

To numerically calculate ^ we use: 

dK ^ K(t)-K(t-dt) _ AK 
dt dt dt 

from which we can define the time average of the absolute value of 
the transfer of kinetic energy per unit of time through: 



< 



dK 
dt 



>,*< 



AK 

dt 



(21) 



where <•>< denotes the time average over the integration of the 
trajectory X(t) up to t = t{. |-| is the absolute value of the 
argument and we use it because we want to relate the quantities of 
Eq. (21) to positive average quantities, such as the positive 
Lyapunov exponents. Accordingly, AK is the amount of kinetic 
energy being transferred between K and P during a time step. 

Since the BEC Hamiltonian (10) is not of the form H = K + P as 
the FPU system, we reside on the calculation of a similar quantity 

AK 

(| — \} t based on the kinetic energy of any of its particles, for 
example of the first particle X\ : 



N 



H 



KS 



-2H-H 



KS • 



(18) 



where tV is half the number of positive Lyapunov exponents 
measured in the subspace. Naturally, N<N/2. However, for the 
simulations we have performed we have set N = N/2. So, 
Xi,i=\,...,N represent the greater than or equal to zero 
Lyapunov exponents of the TV-dimensional projection constructed 
using scalar time series x,, for i= 1, . . . ,7Y, which can be calculated 
in many ways, for example by calculating the finite size and finite 
time Lyapunov exponents or expansion rates [10]. 
^KS = 2~2?= l represents the sum of all greater than or equal 
to zero Lyapunov exponents of the projection (i.e. an approxima- 
tion for the KS entropy) and H= X^li \- Herein, we estimate 
them by computing the Lyapunov exponents of the Hamiltonian 
following [7,8] and by keeping only those that are positive. 

We also need to compute the upper bound lf p for the MIR in 
the bi-dimensional KP space representing the maximum infor- 
mation exchanged between the kinetic (K) and potential (P) 
energies. Using the ideas from Ref. [10], lf p is given by: 



a; jKP 



(19) 



where lf P and kf P are the two positive Lyapunov exponents of 
the KP space with /.f p > lf p . In the case where Xf p < 0, we have 
lf p = ).f p and thus it turns out that MIR* 7 < if (see Ref. [10]). 



AKi 
dt 



>, = < 



Kii^-KAt-dt) 
dt 



>.. 



(22) 



where K\ = \^x\ is the kinetic energy of the first particle. Equation 
(22) is similar to the quantity <| |) ( of the left hand side of Eq. 
(25). 

Set of Initial Conditions 

We prepare the two systems in a systematic way to reside in a 
chaotic regime and be able to produce information. For example, 
for the SP02 we follow Ref. [23] and consider /?= 1 and N= 14 
varying the energy and initial condition X(0) appropriately as 
following: For each fixed energy E of Hamiltonian (3), an 
initial condition X(0) = (x(0),x(0)) is chosen (where x(t) = {x\{t), 
X2(t), . . . ,x N {ij) and x(i) = (k\ (t),X2(t), . . . ,Xfj(t))) so that it lies in 
the neighborhood of SP02. By neighborhood we mean that we 
perturb the equations of motion by a controllable small perturbation 
(i.e. x(i) = x(t) — 10~ 15 ) so that the perturbed initial condition X(0) 
will be at the same constant energy E of SP02. Easily, we can fullfil 
this requirement by solving Eq. (3) for x(N) and then substitute it in 
the initial condition. A demonstration of the importance of this can 
be found in Sec. Results, where we present the relation between the 
largest Lyapunov exponent of the KP space and of the FPU 
Hamiltonian. 

We thus end up with 1 4 nodes, each interacting with its nearest 
neighbours in a 1 -dimensional lattice with fixed ends. In our 
example, SP02 is destabilized at the energy E u x0.l\7 and 
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restabilized again at E, a; 47.059 [23]. Thus, as E increases in 
(E U ,E T ), SP02 is unstable and gives rise initially to weakly and 
then to strongly chaotic behaviour in its neighborhood. For each E 
we numerically integrate the corresponding initial condition X(0) 
and compute the Lyapunov exponents following Refs. [2,7,8] until 
they show a clear tendency to converge to a value. We 
subsequently record their values at the final integration time tt . 
In our case, we have checked that this convergence happens at 
about tf =2 x 10 6 . We denote them as i= 1, . . . ,N arranged in 
descending order. In terms of the numerical integration, we try to 
satisfy the condition that the relative energy error is kept between 
10~ 6 and 10~ 13 . We follow a similar approach for the initial 
conditions we set in the neighborhood of SPO 1 mode of FPU and 
OPM mode of BEC so that we can guarantee chaotic behavior 
with the increase of the energy of the system. 

Results 

Relation Between Largest Lyapunov Exponent of the Bi- 
dimensional KP Space and of the Hamiltonian 

The dynamics on the KP space is driven by the dynamics of the 
Hamiltonian system and we have no explicitly given equations of 
motion for the KP space. As we have already pointed out, we 
choose initial conditions X(0) on the same energy as the SP02, 
and this implies that points (K(Xi{t)),P{X\(t))) and (K(X 2 (t)), 
P(X 2 (t))) belong to the line K(X(t)) + P(X(t)) = E. The motion 
takes place on this 1 -dimensional subspace and thus, there is only 
one Lyapunov exponent Xf F that leads to lf F = Xf F . 

In Fig. 1 , one can see schematically the time evolution after one 
time step dt of a deviation vector (denoted as an arrow) along the 
direction of the Lyapunov exponent Xf F defined for the dynamics 
on the line K + P = E. Here X\{f) and Xzif) are two trajectories in 
the phase space of Hamiltonian (3) on the same energy E as SP02, 
started initially in its neighborhood and being infinitesimally close. 
Then, Xf is the rate of expansion of the deviation vector defined 
by the points (JC(.?i(0),P(5i(f))) and (K(X 2 (t)),P(X 2 (t))). Here, 



p 

(0.E) 



\i (K-(*i(t)),P(-X-i(t))) 
K'N, i,K(X 2 (t)),P(X 2 {t))) 



(K(X 1 (l+dt)),P(X 1 (t+dt))) 



(K(Xi(t + dt)).P(X 2 (t + dt))) 
\ P= -K + E 
slope= —1 ' ^ 




(0,0) 



(E,0)K 



Figure 1. Schematic representation of the time evolution after 
one time step dt of two deviation vectors (arrows) correspond- 
ing to the direction along the Lyapunov exponent if on the 1- 
dimensional subspace K + P=E on the KP space. X\(t) and X 2 (t) 
are two trajectories in the phase space of Hamiltonian (3) that drive the 
dynamics along this line. We denote with S and A the lengths of the 
two deviation vectors initially and after one time step, respectively. 
doi:10.1371/journal.pone.0089585.g001 



0 and A denote the lengths of the initial and after one time step 
deviation vectors respectively. 

lf F can be defined for infinitesimally close-by points on the 1- 
dimensional space of K + P = E of Fig. 1 by keeping track of the 
evolution of their distance. In particular, for such points 
(KiXiit^PiXiit))) and (K(X 2 (t)),P(X 2 (t))), their distance is 
given by: 



AK x (t) 2 = (tf (1, (0) - K(X 2 (t))) 2 + (0) - P(X 2 (t))) 2 - 



(tf (1, (0) - K(X 2 (t))) 2 + (E-K(X l (t))-E + K(X 2 (t))) 2 - 



Defining: 



2(tf(X 1 (0)-tf(X 2 (0)) 2 



AK x (t) = s/2\ K(X (0) - K (1 2 (0)| • (23) 



^7 log( Hi )/o '-^ (0) - 0 ' 



and combining it with Eq. (23) we obtain: 



;f=Hm i B^z^M). (24) 

\K{Xm)-K(X 2 {0))\ 



We denote as X\ the largest Lyapunov exponent in the 
neighborhood of SP02, and reside on numerical simulations to 
show in Fig. 2 that Xf F is actually X\ . In the example of Fig. 2 we 
have set E = 30, resulting in the relation K + P = 30. However, we 
have checked that the above result is valid for all energies we 
considered in (E u ,E r ). We observe that — Xf F \ tends to zero in 
the course of time and that at some point starts to saturate at about 
10~ 4 due to round off numerical errors. In other words, we have 
showed that the largest Lyapunov exponent of the 1 -dimensional 
K + P = E space is equal to the largest Lyapunov exponent X\ of 
Hamiltonian (3), i.e. Aj =X\. 

To achieve this result, we integrated simultaneously two 
infinitesimally close trajectories X\(t) and X 2 (t) (e.g. at an initial 
distance of the order of 10~ 7 ) on the same energy as SP02 and 
consider thus that Atf(0)« 10~ 7 , and replace the limits in Eq. (24) 
by a finite time t = 2x 10 6 , computing Xf F as a time average [8], 
i.e. as finite size and finite time Lyapunov exponent. Since for 
chaotic trajectories, the distance between Xi(t) and X 2 {t) quickly 
saturates, we periodically renormalize their separation without 
altering their relative orientation in phase space and then compute 
the new distance \K(Xi(t)) - K(X 2 (t))\ setting 
|tf(li (0)) - K (1 2 (0))| = \K (li (/ - dt)) - K(X 2 (t - dt))\. To avoid 
any numerical overflows, we preferred to do this at every time 
step. 

Note that Xf F = X\ is not an unexpected result, since the largest 
Lyapunov exponent should be obtained in typical low-dimensional 
linear projections or embedding spaces [3,32]. By typical here we 
mean bi-dimensional subspaces or projections that are not 
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30 40 



Figure 2. Plot of the absolute difference X\ if F as a function 
of time for two trajectories X\(t) and X 2 (t) located initially in 
the neighborhood of SP02 at the same energy E. Here, £ = 30 is 
well inside the interval {E Ut E c ), Note that both axes are logarithmic. 
doi:1 0.1 371 /journal.pone.0089585.g002 



oriented along Lyapunov vectors. However, the KP space is a 
highly nonlinear projection still maintaining the largest positive 
Lyapunov exponent of the Hamiltonian as we have demonstrated. 
Every initial condition creates a trajectory with only one positive 
Lyapunov exponent in the KP subspace. Therefore, lf p = Xf p . 

Concluding this part, we have demonstrated that the transfer of 
information from K to P is mediated by the largest Lyapunov 
exponent of the Hamiltonian. We finally obtain: 



MIR^</*' 



The last result implies that the upper bound lf p for the MIR 
between kinetic and potential energies is equal to the largest 
Lyapunov exponent of the Hamiltonian and consequently, 
MIR*- P can not be bigger than this exponent. 

Relation Between Production and Transfer of Information 
in the Small Energy Regime 

To start with, we present in a log-log plot in Fig. 3 the quantities 
I c of Eq. (18) in red dashed line with points, i/jts of Eq. (1) in 
green dashed line with rectangles, lf p = X\ in black solid line with 
AK 

lower triangles and <| -— — ■ |), of Eq. (21) in blue dashed line with 

upper triangles for the SP02 case of the FPU system with 
parameters as denned in Subsec. Fermi-Pasta-Ulam Hamiltonian. 
Here dt is the time step of the integration (i.e. dt«\). The time 

dK 

derivative of the kinetic energy - — - accounts for the rate of transfer 

from kinetic to potential energy. We see that all quantities follow 
the same morphology (i.e. share the same functional form) as the 
energy of the initial condition X(0) is increased in the interval 
(E u ,E r ). Moreover, //ks is an upper bound of the upper bound 
I c for the MIR between two groups formed each by 7 nodes. We 
will prove a related inequality in Information S 1 . 

AK 

The approach we shall follow to relate <| -— — 1>, with lf p for 

the transfer of information between K and P is meaningful as long 
as the motion in the Hamiltonian phase space is chaotic (e.g. as 



Figure 3. Plot of the quantities: I c as defined by Eq. (18) in red 
dashed line with points, // K s as defined by Eq. (1) in green 
dashed line with rectangles, if* as defined by Eq. (19) in black 

AFC 

solid line with lower triangles and (|— r~ )/ as defined by Eq. 
(21) in blue dashed line with upper triangles as a function of E 
for initial conditions A (0) located in the neighborhood of SP02 
of the FPU system. Note that both axes are logarithmic. 
doi:10.1371/journal.pone.0089585.g003 



long as Ee(E u ,E T )). If the motion is periodic or quasi-periodic 
there is no exchange of information between the nodes (i.e. by 
knowing the position of a particular node one can predict the 
position and momenta of another one). Our results show that 
AK 

\~)t ls related by a power-law to the largest Lyapunov 

exponent X\ of the Hamiltonian and to the upper bound lf p for 
the transfer of information between kinetic and potential energies. 
Surprisingly, we have found that this is valid for sufficiently large 
enough subintervals, i.e. for Ee(E u ,E T ). 

Here, we need to make use of only one neighboring initial 
condition X(Q) of SP02 and denote for simplicity by 
K(t) = K(X(t)). With the help of Eq. (21) and 
AK = AK(t) = K(t) — K(t — dt) we have found numerically that: 



< 



AK 

dt 



(25) 



for the same energy interval that Eq. (20) applies where bi is a real 
positive constant. By substituting Eq. (20) in Eq. (25), we obtain: 



< 



AK 

lit 



(26) 



where we have used lf p = X\ (see Subsec. Relation Between 
Largest Lyapunov Exponent of the Bi-dimensional KP Space and 
of the Hamiltonian). It is straightforward to show that the same 

AP 

power-law (26) applies to due t0 ^qs. (14) and (16) 



respectively. We emphasize that 
AK, 



AK, 
dt 



is a time-ratio that depends 



on time, and that (\ — — |), and X\ are time invariant averages. 

Fig. 4A shows in a log-log scale the quantity I c of Eq. (18) in red 
dashed line with points and T/rs of Eq. (1) in green dashed line 
with rectangles. In panel B, we plot lf p = X\ with red points and 
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the power-law fitting: 



(27) 



with green line. The agreement is remarkable. In Fig. 4C we plot 



rBS . 



-at, + bt,E c < s - , a 4 ,A 4 ,c 4 eR, 



(32) 



dt 



•) t = a 5 + b 5 (c 5 + E) d \ a 5 ,b 5 ,c 5 ,d 5 eU. (33) 



< 



AK 



dt 



) t = a 2 E"2 



(28) 



showed as green line. We find that a\ «0.03, b\ x 0.489 and that 
«2 ~ 0.25, &2 * 1-267. In panel D of the same figure we plot 
AK 

<| | with red points as a function of Z^ 7 = Ai for values that 

correspond to the same energy interval of panels A, B and C. The 
power-law fitting: 



< 



AK 



(29) 



plotted in green dashed line gives 03 ~ 3077.79 and bj,x 2. 60 
which is in good agreement with the value of bi/bi «2.591. The 
above arguments directly imply that: 



AK 



dt 



>,oc(/fy. 



v N ' 



(30) 



where the proportionality constant a3 = fl2(^)^ and &3= 62/^1 • 

To arrive at Eq. (30) we have used lf F = X\ of Subsec. Relation 
Between Largest Lyapunov Exponent of the Bi-dimensional KP 
Space and of the Hamiltonian and Eq. (2) presented in 
Information SI. Equation (30) relates the production A\ and 

A^ 

transfer of information lf F in the KP space with an d 

//ks- Therefore, the larger the transfer of energy is between 
the kinetic and potential energy, the larger is the upper bound for 
the MIR between the kinetic and potential energies and the 
larger the KS entropy of the system will be. In other words, 
exchange of information between K and P implies exchange of 
energy, and vice-versa. However, a relatively small increment of 
energy transfer produces a larger relative increase of the 
information transferred since 63 > 1 . 

In Information SI we prove another important result which is 
the inequality: 



If<I c <H KS , 
and thus justify the result presented in Fig. 3. 



(31) 



Generalization of our Study 

Here, we extend our study and present the generalization of our 
predicted upper bounds for the MIR and the connection with the 
transfer of energy of the previous section by considering higher 
energy intervals with initial conditions set in different parts of the 
phase space of two Hamiltonian systems: the FPU (3) and BEC 
(10). 

We will show that if one considers a much larger energy interval 
for these systems with initial conditions set in different parts of 
their phase spaces, then Eqs. (27), (28) and (29) can be generalized, 



We prefer to call Eqs. (32) and (33) as generalized power-law 
functions. Here, BS stands for the bi-dimensional space of 
observation. In the case of the FPU system (3) we consider as a bi- 
dimensional space the KP space while for the BEC system (10) we 
consider the observation space constructed by observing the pair 
of variables X\ and Xy, that is by the position of the first and last 
particle. In Sec. Hamiltonian Communication System, where we 
study an "experimental" setup of a 1 -dimensional communication 
channel based on the FPU system, we will use this particular 
observation space as well. 

By eliminating E from both Eqs. (32) and (33), one arrives at the 

„ AK IS 

relation between transfer of energy per unit of time (i.e. <| ~^~\/t) 
and upper bound of information transmitted in the bi-dimensional 
space BS (i.e. 7 C BS ): 



AK 



dt 



a 6 + b(y[c 6 + (- 



V 



e6 



(34) 



-i b f b , a 6 ,b 6 ,C6,d6,e6/b,g6eU. 



Parameters a,,fe,-,c,,<5? J ,e I j/),g",- can be determined by performing 
a non-linear fitting of the numerical data by the functions (32), (33) 
and (34). We have used Matlab to perform these fittings. 

FPU SP02 

In the case of the SP02 studied in Subsec. Relation Between 
Production and Transfer of Information in the Small Energy 
Regime, the fit of Fig. 4 was performed in the energy interval 
[30,47]. Here we generalize Eqs. (27), (28) and (29) in the larger 
energy interval [3,47] for which the dynamics around SP02 is 
chaotic as indicated by the Lyapunov exponents. This allows the 
creation and transfer of information and energy. We have used the 
same parameters and setup (e.g. 14 particles) to allow for a direct 
comparison between Figs. 4 and 5. 

By doing a similar analysis as in Subsec. Relation Between 
Production and Transfer of Information in the Small Energy 
Regime, we present in Fig. 5 the plots of all relevant quantities for 
the larger energy interval. By fitting the new data with the 
generalized power-laws of Eqs. (32), (33) and (34) we have: 
a 4 «-0.07, 6 4 «0.07, c 4 «0.34 for Eq. (32), « 5 w-1.16, 
6 5 «0.18, c 5 «3.64, rf 5 «1.34 for Eq.(33) and finally: 
a b x -14.83, fo 6 «2.27x 10- 15 , c 6 «32.41, rf 6 «0.01, e 6 «0.1, 
f 6 « 1 .97 and g 6 « 10.47 for Eq. (34). 

FPU SP01 

Here we extend our study to a another part of the phase space 
of the FPU Hamiltonian with initial conditions set in the 
neighborhood of the periodic orbit SPOl (see Eq. (4) of Subsec. 
Fermi-Pasta-Ulam Hamiltonian). We have chosen this particular 
part of the phase space as SPO 1 does not restabilize at some bigger 
energy as it happens with SP02 and thus allows to reach as high 
energies as desired. We will show that the same generalized power- 
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1 

<|AK/dt|>, 

0.25 *E 1 2669 



36.8 



40.2 
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47 



10' 



10' 



0.140 



0.147 



~\ 1 1 

<|AK/dt|>, • 

3077.79 * (l c KP ) 2 60 



0.153 



0.160 



_l_ 



0.167 0.174 



Figure 4. Plot of quantities: /, of Eq. (18) in red dashed line with points and // K s of Eq. (1) in green dashed line with rectangles 

AK 

(panel A). Plot of quantities lf r =X\ with red points with the power-law fitting of Eq. (27) in green line (panel B). Plot of <| — j— 1> ( with red points 



AX 
~dt 



clt 

>, to lf=Xi in red points, in the interval (0.140,0.174) 



with the power-law fitting of Eq. (29) in green line (panel C). Power-law dependence of < 

that corresponds to the energy interval [30,47] of panels A, B and C and of the power-law fitting of Eq. (29) in green dashed line (panel D). Note that 
all axes are logarithmic. 



laws of Eqs. (32), (33) and (34) can still be used to fit the data of the 
upper bounds for MIR such as I c , H^s and lf p . In more details, 
for Eq. (32) we have: 04 « -0.18, b 4 «0.15, c 4 «0.23, for Eq.(33) 
we have: as* —0.99, 65 « 0.26, C5«0, d^~l.25 and finally, for 
Eq. (34) we have: a 6 x -14.33, 2> 6 «2.91, c 6 «1.68, d 6 x -0.08, 
e 6 «0.17,/ 6 «1.39 and g 6 x 3.62. 

In Fig. 6 we present the corresponding plots and fits for the 
energy interval [3,1 0 4 ] considering 15 particles and /8=1. 
Following Ref. [23], for these values we know that the dynamics 
around SPOl is chaotic and thus allows the production and 
exchange of energy and information in the FPU chain. 

BEC OPM 

Next, we proceed and study the same problem for a different 
system, namely the BEC Hamiltonian given in Eq. (10). We have 
chosen this system as it allows us to study the relation between 
transfer and exchange of energy and information in a different 
Hamiltonian system than the FPU. Furthermore, because it is not 
written in the form H = K + P as the FPU does (compare Eqs. (3) 
and (10)). It will thus permit us to demonstrate the validity of the 
upper bounds for the MIR and the connection between the 
exchange of energy and information in different observation 
spaces. 

In particular, we consider here a small version of the system 
with N = 6 degrees of freedom (particles) with initial conditions set 
in the neighborhood of the OPM periodic orbit given in Eq. (13) 



with periodic boundary conditions (see Eq. (12)). In Fig. 7, we 
show the results of a similar study as we did in the cases of SPO 1 , 
SP02 of the FPU system, for the energy interval (3.94,1037.56) 
for which we have been able to study numerically in terms of the 
preservation of the accuracy of the computed energy. For this 
energy interval we know that the dynamics is chaotic (see Ref. 
[24]). Since, as we have already pointed out, BEC is not given by 
the sum of the kinetic and potential energy, we adopt a different 
strategy and reside on the calculation of the similar quantity 

(| |), based on the kinetic energy of the first particle X\ (see 

Eq. (22)). However, the kinetic energy of any other particle can be 
used as well. By fitting the data with the generalized power-laws of 
Eqs. (32), (33) and (34) we have: a 4 « -0.33, 6 4 «0.28, c 4 «0.17 
for Eq. (32), a 5 x -9.1, b 5 xOAl, c 5 « 32.41, d s « 1.26 for Eq.(33) 
and finally: a 6 x -9.1, Z> 6 «0.11, c 6 «32.41, d 6 x036, e 6 «0.31, 
/ 6 «6.29 and g 6 ~l-21 for Eq. (34). 

Hamiltonian Communication System 

In this section we present an "experimental" implementation of 
a 1 -dimensional communication channel based on the FPU 
Hamiltonian system of Eq. (3), and show the relation between our 
proposed upper bounds for the MIR with the actual MIR 
measured for the exchange of information between the first and 
last particle of the channel. 
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<|AK/dt|>, 
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<|AK/dt|>, • 
'('c KP )sP02 — — — 



_1_ 



_1_ 
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i<T=h 



Figure 5. Plot of quantities: I as defined by Eq. (18) in red dashed line with points, // K s as defined by Eq. (1) in green dashed line 

AH 

with rectangles, if as defined by Eq. (19) in black solid line with lower triangles and < —jrW as defined by Eq. (21) in blue dashed 
line with upper triangles as a function of E for initial conditions X(0) located in the neighborhood of SP02 of the FPU system (panel 

A). Note that both axes are logarithmic. Plot of if = X\ with red points with the power-law fitting of Eq. (32) in green line (panel 



with red points with the power-law fitting of Eq. (33) in green line (panel C). Power-law dependence of (| 



AK 

lit 



A K 

Plot of <|_|>, 



|>, to If = X\ in red points, in the 



interval (0.02,0.174) that corresponds to the energy interval [3,47] of panels A, B and C and of the power-law fitting of Eq. (33) in green dashed line 
(panel D). Note that all axes are logarithmic. 
doi:1 0.1 371 /journal.pone.0089585.g005 



In more details, we consider the FPU chain of N oscillators as a 
1 -dimensional communication channel where information and 
energy flow from one end to the other, i.e. from the first particle X\ 
to the last one Xn and vice versa. To extend the applicability of 
our theoretical results obtained in the previous sections for 
different cases of chaotic dynamics, we will use the dynamics 
around SPOl and SP02 and consider as a bi-dimensional 
observation space the one constructed by the evolution of the pair 
of position variables X\,x^ of the first and last particle of the FPU 
chain of Eq. (3). The computation of the actual MIR value 
between the two observation nodes X\ ad x^ was based on the 
theory presented in Ref. [10]. Here, we consider 15 oscillators 
(degrees of freedom) for the SPOl and 14 for the SP02. 

In panel A of Fig. 8 we show the results of our study for the 
SP02 case. We have plotted in red dashed line with points the 
quantity I c of Eq. (18), as defined by Eq. (1) in green dashed 

line with rectangles, If of Eq. (19) in black solid line with lower 
triangles and MIR! 14 in blue dashed line with upper triangles as a 
function of the energy E. Here, MIR^ 14 stands for the actual 
mutual information rate measured for the exchange of information 
between X\ and X\$. From our theoretical results derived in the 
previous sections we expect that MXR ljl4 should be smaller or 
equal than if. This is indeed what one observes as the MIR t 14 
curve is smaller than the previously mentioned upper bound and 



more importantly, it follows the same morphology (functional 
form) as I c , Ilfcs and if. We have performed the same analysis 
for the SPOl case as well showed in panel B of the same figure and 
arrive again at the same conclusions, i.e. MIR] 15 lies below If as 
expected by our study and follows the same morphology as the 
upper bounds I c , Hxs and if. In this case, MIR[ 15 denotes the 
actual mutual information rate measured for the exchange of 
information between X\ and X15. 

Discussion 

In this paper we have studied the relation among the transfer of 
energy from kinetic (K) to potential (P) energies, the transfer of 
information between these two quantities and between different 
particles, the production of information, and Lyapunov exponents 
in Hamiltonian systems. 

Our first result is that the largest Lyapunov exponent of the bi- 
dimensional space of the kinetic and potential energy is equal to 
the maximal Lyapunov exponent of the Hamiltonian in the case it 
is given by the sum of the kinetic and potential energy. 
Consequendy, we were able to show that the upper bound for 
the MIR in the KP subspace is given by the largest Lyapunov 
exponent of the Hamiltonian This implies that the more 
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Figure 6. Plot of quantities: /, as defined by Eq. (18) in red dashed line with points, // K s as defined by Eq. (1) in green dashed line 

AH 

with rectangles, if as defined by Eq. (19) in black solid line with lower triangles and < —r~W as defined by Eq. (21) in blue dashed 
line with upper triangles as a function of E for initial conditions A id) located in the neighborhood of SPOl of the FPU system (panel 



A). Note that both axes are logarithmic. Plot of If 



AK. 

-X] with red points with the power-law fitting of Eq. (32) in green line (panel B). Plot of < — — I), 

at 
AK 

with red points with the power-law fitting of Eq. (33) in green line (panel C). Power-law dependence of <|— to lf = X\ in red points, in the 

at 

interval (0.07,1) that corresponds to the energy interval [10,10 4 ] of panels A, B and C and of the power-law fitting of Eq. (33) in green dashed line 
(panel D). Note that all axes are logarithmic. 
doi:1 0.1 371 /journal.pone.0089585.g006 



information the Hamiltonian system produces the more 

information can be exchanged between K and P. 

The second important result we have found is a power-law 
relation between the rate of transfer from kinetic to potential 
energy, the largest Lyapunov exponent of the Hamiltonian, and 
the Kolmogorov-Sinai entropy of the Hamiltonian. The more 
chaotic and the more information the Hamiltonian system 
produces {k\ and .//ks) respectively, the larger is the time average 
of the absolute value of energy transferred between K and P per 

unit of time (i.e. <| —j- \ >,). 

The other important result is the proof of the inequality 
if <I C < //ks shown in Information SI. It implies that, when 
one observes a Hamiltonian system through its kinetic and 
potential energies (thus obtaining if), one measures less 
information about the Hamiltonian system than when observing 
half of its variables (thus obtaining I c ) or all of its variables (thus 
obtaining //ks). 

Finally, we have proposed an "experimental" implementation 
of a 1 -dimensional communication channel based on a Hamilto- 
nian system, and have calculated the actual rate with which 
information is exchanged between the first and last particle of the 
channel and compared that with the upper bounds we have 



proposed. As expected from our theoretical analysis, in all cases we 
have studied the actual MIR values were found to be smaller than 
our proposed upper bounds of MIR. 

It is challenging to sketch here a possible connection between 
our results and the free energy F, entropy S, temperature T and 
Hamiltonian energy E in the thermodynamic limit, i.e. when E 
and N grow indefinitely while their ratio E/N remains constant. 
According to the definition attributed to Helmholtz, F is equal to 
the internal energy of the system U minus the product of the 
(absolute) temperature T multiplied by S, i.e. F=U— TS. T is an 
important macroscopic quantity since its definition goes back to 
the early days of thermodynamics. Maxwell had realized that 
when the Hamiltonian has the special form: 

H(x,x)=^x 2 + P(x,...), 

(as is the case of the FPU system we have studied in this work) the 
canonical ensemble average of x 2 is the temperature T of the 
system. Thus, if one assumes ergodicity and equivalence of 
ensembles of initial conditions, it suffices to measure the time 
average of x 2 during the evolution of the system in order to 
compute T (see for example Ref. [33]). Then, U in this context is 
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Figure 7. Plot of quantities: /, as defined by Eq. (18) in red dashed line with points, // K s as defined by Eq. (1) in green dashed line 



with rectangles, if as defined by Eq. (19) in black solid line with lower triangles and < 



AK, 

lit 



, as defined by Eq. (22) in blue dashed 



line with upper triangles as a function of E for initial conditions X(0) located in the neighborhood of the OPM of the BEC 
Hamiltonian (panel A). Note that both axes are logarithmic. Plot of (A\ — I2) with red points with the power-law fitting of Eq. (32) in green line 

AK AK 
(panel B). Plot of <| — with red points with the power-law fitting of Eq. (33) in green line (panel C). Power-law dependence of (I — — I), to 

at ' at 

(1] — A2) in red points, in the interval (0.02,0.57) that corresponds to the energy interval (3.94,1037.56) of panels A, B and C and of the power-law 
fitting of Eq. (33) in green dashed line (panel D). Note that all axes are logarithmic. 



the fixed energy of the Hamiltonian (e.g. FPU) E{ = K + P) and S have: 

can be calculated by the KS entropy as S = cc//ks , where a p = g_ 7' a // KS => 

has the unit of time, since KS entropy is simply Shannon's entropy 

(equivalent to Gibb's entropy) per unit of time. Therefore, one can F = K + P— TaH^ , (35) 





Figure 8. Plot of the quantity /, as defined by Eq. (1 8) in red dashed line with points, // K s as defined by Eq. (1 ) in green dashed line 
with rectangles, if as defined by Eq. (19) in black solid line with lower triangles and MIR 1i14 in blue dashed line with upper 
triangles as a function of E for initial conditions X(0) set in the neighborhood of SP02 (panel A). Same as in panel A for initial conditions 
set in the neighborhood of SP01 (panel B). Note that all axes are logarithmic. 
doi:1 0.1 371 /journal.pone.0089585.g008 
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and by solving Eq. (35) to obtain: 

K + P-F 



H 



KS 



(36) 



If Eq. (30) remains still valid in the thermodynamic limit, then 
by substituting Eq. (36) in the right hand side of Eq. (30) one has: 



< 



AK 



> ( <x(/f)*i=a 1 )*i=(2 



K + P- 

aTN 



(37) 



which relates the rate of transfer from kinetic to potential energy 
and the largest Lyapunov exponent of the Hamiltonian with the 
free energy and temperature of the system. This provides a direct 
relation between the results of this paper and important quantities 
of thermodynamics and Statistical Mechanics as long as the same 
conditions required for the derivation of the main results of our 
paper hold for Eq. (37) as well. Equation (37) implies that the 
larger the gap between the energy of the Hamiltonian and the 
available energy to do work (the free energy) the smaller the 
transfer of energy and information from K to P is. 

In a series of papers [20,34—36], the authors discuss about 
technological applications of the transfer of energy and informa- 
tion in communication, interference and graphical networks and 
show how one can reuse part of the energy for successive 
communication tasks. These ideas are based on results from 
physics showing that any system that exchanges information via 
the transfer of given physical resources such as radio waves, 
particles, etc., can reuse part of the received resources. If chaotic 
Hamiltonian systems could be used to create a communication 



system such that energy of the transmitting signal could be reused 
to transmit more information, from Eq. (37) it is clear that F must 
be different than zero implying that less information can be 
transmitted. 

We believe that our work provides a viable pathway to establish 
similar relations between production and transfer of energy and 
information in other Hamiltonian systems for which the Lyapunov 
exponents have different dependences with the increase of the 
energy of the system as compared to those we have found here. 
Moreover, the choice of the bi-dimensional observation space is 
not restrictive and a plausible one can be constructed by the 
position coordinates of any two particles of the system. Of course, 
in these cases it is expected that our power-law relations will be 
replaced by new ones reflecting the different properties of the 
systems. 
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